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(54) IMAGE PROCESSOR AND RECORDING MEDIUM BEARING VOICE CODE IMAGE 



(57) An image processing apparatus capable of 
simply and reliably handling two different forms of infor- 
mation, audio and image, as linked together in order to 
record the information on the same recording medium. 
This image processing apparatus has an image input 
unit (10) for inputting image information, an audio input 
unit (60) for inputting audio information, a link process- 
ing unit (130a) for setting link information to link the 
image information and audio information, a code con- 
verter (242) for converting the audio information into an 



10. 



optically readable audio code image, and a printing 
device (30) operable based on the link information for 
recording a visual image corresponding to the image 
information and the audio code image on a predeter- 
mined recording medium. One can not only visually 
enjoy the image recorded on the recording medium, but' 
hear a sound from the audio code image recorded on 
the recording medium with an appropriate reproduction 
device. 
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Description 
TECHNICAL FIELD 

[0001] This invention relates to image processing 
apparatus for printing, with optically readable audio 
code images added, images acquired with silver salt 
type cameras, image data handling digital still cameras, 
image reading scanners and the like. 

BACKGROUND ART 

[0002] Images photographed with various image 
acquiring devices are printed on printing paper by the 
silver salt photographic method, or on paper or film by 
using an ink jet printer, thermal printer or the like. Thus, 
over long years, information on photographic objects 
has been transmitted in the form of still images relying 
on the sense of sight across wide areas and in a time- 
less way. 

[0003] Recently, with the advent of the multimedia 
age, vigorous attempts have been made to use the 
sense of hearing in the transmission of information, 
instead of relying solely on the sense of sight. Olympus 
Optical Co., Ltd., which is one of the joint applicants in 
this application, also has proposed new media for pro- 
viding not only visible but audible Information in Japa- 
nese Patent Laying-Open Publication H6-231466 and 
Japanese Patent Laying-Open Publication H7-181606, 
for example. According to this technique, recording 
media include sound converted into optically readable 
dot codes (audio code images) which are printed along 
with pictures, photographs or characters on the same 
paper, the dot codes being read with a special scanner. 
These new media are suited to various applications 
including language teaching materials for use in repeat- 
ing pronunciation practice, illustrated reference books 
for recording animal cries, picture books which emit 
sound, and photographs for recording memorial events 
such as wedding, coming-of-age ceremony and cele- 
bration for children. 

[0004] With the above new media technique, audio- 
coded photographs with audio code images corre- 
sponding to a plurality of image information (still images 
such as photographs) and a plurality of audio informa- 
tion may be made, for example, by recording animal 
cries on animal photographs, or recording voices of a 
plurality of people on snapshots of these people simul- 
taneously with or after the photo taking. These photo- 
graphs provide a salient improvement upon 
conventional photographs In enhancing the realism and 
communicable information of acquired images. How- 
ever, what is important here is to associate pieces of 
information accurately when recording both image infor- 
mation and audio information on prints or other record- 
ing media. 

[0005] A detailed disclosure concerning the associa- 
tion of such image information and audio information is 



not given in Patent Laying-Open Publication H6-231466 
noted above, or in other publications disclosing record- 
ing on recording media of both image information and 
encoded audio information, such as Japanese Laying- 

5 Open Publication S56-5600, Japanese Laying-Open 
Publication S60-244146, Japanese Patent Laying-Open 
Publication H5-224320 and Japanese Patent Laying- 
Open Publication H7-181606. 
[0006] Why association is important is that, since 

10 audio code images on finished audio-coded photo- 
graphs themselves cannot be confirmed visually, a situ- 
ation could arise, depending on an arrangement of 
visual images and audio code images, where it is 
impossible to determine which one of a plurality of vis- 

75 ual images corresponds to a given audio code image. 
Such collation is difficult particularly with audio-coded 
photographs having audio code images arranged en 
bloc in a particular area to facilitate scanning and read- 
ing of audio codes with a scanner. 

20 [0007] An object of this invention Is to provide an 
image processing apparatus for simply and reliably han- 
dling two different types of information, i.e. audio and 
image, as associated with each other, and audio-coded 
photographs for allowing audio and image to be collated 

25 easily even where the audio-coded photographs have a 
plurality of visual images and a plurality of audio code 
images arranged thereon. 

DISCLOSURE OF THE INVENTION 

30 

[0008] To fulfill the above object, an image processing 
apparatus according to this invention comprises image 
input means for inputting image information, audio input 
means for inputting audio information, link processing 

35 means for setting link information to link said image 
information and said audio information, code converting 
means for converting said audio information Into an 
optically readable audio code image, and a printing 
device operable based on said link information for 

40 recording a visual image corresponding to said image 
information and said audio code image on a predeter- 
mined recording medium. 

[0009] In this construction, link information is set for 
linking image information and audio information. Based 

45 on this link information, a visual image corresponding to 
the image information and an audio code image corre- 
sponding to the audio information may be recorded as 
linked to each other on a predetermined recording 
medium. The recording medium here refers to any of 

50 various hard copy materials such as ordinary printing 
paper and printing film, or photosensitive materials such 
as printing paper and film (negative and positive). 
[001 0] In one preferred embodiment of this invention, 
said code converting means comprises compressing 

55 and -encoding means for compressing and encoding 
said audio information, and audio code image generat- 
ing means for converting said audio information com- 
pressed and encoded, into an optically readable audio 



3 



EP 0 928 986 A1 



4 



code image. Thus, the audio information may be con- 
verted into an optically readable audio code image com- 
pactly and reliably. 

[0011] Further, in one preferred embodiment of this 
invention, said code converting means is operable to 
convert both of said audio information and said link 
information into an optically readable audio code image. 
Thus, the audio information may be reproduced only by 
decoding the code data read. The relationship between 
the image information and audio information may be 
grasped reliably. 

[0012] As a preferred embodiment of this invention, 
said link information includes layout information show- 
ing an arrangement of said visual image and said audio 
code image to be recorded on said recording medium. 
The layout information may be grasped only by decod- 
ing the audio code image read. This is advantageous 
particularly when making duplicates. Further, said link 
information may include source address information 
showing image information or a source storage of said 
visual image and audio information or a source storage 
of said audio code image to be recorded on said record- 
ing medium. Then, original data may be located with 
ease to simplify a duplicating operation. 
[0013] Further, said link information may be a recog- 
nition sign applied commonly to said image information 
and said audio information and showing a correspond- 
ence therebetween, and said printing device may be 
operable to visibly display and record said recognition 
sip. Then, the relationship between the image informa- 
tion and audio information may be grasped visually and 
reliably 

[001 4] In another preferred embodiment of this inven- 
tion, said printing device is operable to record said 
audio code image in a blank region outside a visual 
image recording region or on the back of said recording 
medium. Then, the recording position of the code image 
may be separated from the recording region of the 
image information to allow the image information to be 
grasped reliably and the audio code image read to be 
decoded effectively. Said printing device may be opera- 
ble to record said audio code image in superimposition 
on said visual image. Then, the audio code image may 
be recorded without reducing the size of the visual 
image recording region. 

[0015] Said printing device may be operable to com- 
bine and record said visual image and said audio code 
image. Then, the audio code image may be recorded 
without reducing the size of the visual image recording 
region. 

[001 6] Said printing device may be operable to record 
said visual image and said audio code image on a print 
recording medium. Then, information recorded in the 
image information and audio code image may be 
grasped by using an inexpensive and handy print 
recording medium. This new print recording medium 
may be diffused widely. 

[0017] Further, said printing device may be operable 



to record said visual image and said audio code image 
on a photosensitive recording medium, e.g. negative or 
positive film, printing paper or the like. Then, information 
recorded in the image information and audio code 

5 image may be grasped accurately by using a photosen- 
sitive recording medium of high image quality, and high 
image quality specilications may be satisfied. 
[0018] As a further preferred emtjodiment of this 
invention, said image input means acquires image infor- 

10 mation by using at least one of a scanner for reading 
photographic images formed on a photograph film or 
photographic images formed on photographic prints, an 
image signal input unit for taking in photographic 
images photographed with a digital still camera or a 

15 video movie camera, and an image signal input unit for 
taking in images made or edited with a computer. In this 
case, a variety of image input means including public 
communications networks (telephone, Internet and so 
on) are applicable to suit various uses. 

20 [0019] In a different preferred embodiment of this 
invention, said link processing means comprises an ID 
information applying means for applying ID information 
as said link information to identify at least one of said 
image information and said audio information, and sets 

25 link information for linking one to the other of said image 
information and audio information based on said ID 
infonnation. In this construction, an operation may be 
carried out while reliably maintaining, without duplicat- 
ing, the relationship between the image information and 

30 audio information, by applying the link information 
based on identifiable ID information. 
[0020] Further, said link processing means may com- 
prise monitor means for monitoring at least one of said 
image information and said audio information, and infer- 

35 mation designating means for designating information 
so that one links to the other of said image Information 
and said audio information monitored by said monitor 
means, and set link information based on an output 
from this information designating means and said ID 

40 information. In this case, the link information may be set 
reliably to suit the user's wish, without duplicating the 
correspondence between the image information and 
audio information by designating information to be 
linked and providing link information while monitoring 

45 the image information and audio information on the 
monitor means such as a CRT. 
[0021 ] The information designating means may be a 
pointing device, e.g. a keypad, a mouse, a track pad and 
a touch panel, operable by a user to designate desired 

so information regarding said image information or said 
audio information outputted to said monitor means. 
Then, the link information may be set reliably and simply 
to suit the user's wish. 

[0022] To achieve a different object of this invention. 
55 an audio-coded recording medium according to this 
invention is characterized in that visual images corre- 
sponding to a plurality of image information and a plural- 
ity of audio code Images corresponding thereto are 
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arranged, and recognition signs showing a correspond- 
ence between image information and audio information 
are visibly displayed and recorded. 
[0023] In this construction, since a recognition sign 
which can be confirmed visually is applied to the visual 
image and the audio code image corresponding thereto, 
the audio code image corresponding to the visual image 
may be selected visually when scanning the audio code 
with a scanner. The recognition sign is used here in a 
broad sense, and is defined as a term including not only 
numerals and characters but of course a line or the like 
connecting the visual image and the audio code, and 
codes which emit sound and/or light. 
[0024] Further, as a preferred embodiment of this 
invention, a plurality of audio code images are collec- 
tively arranged in a predetermined audio code image 
recording region. Then, by setting a lower portion of a 
photograph to be an audio code area, for example, posi- 
tioning of a scanner may be made easily when scanning 
and reading an audio code. In this case, each audio 
code image is disposed in a position away from a corre- 
sponding visual image. However, the recognition code 
allows the audio code image corresponding to the visual 
image to be grasped reliably This provides an espe- 
cially important advantage in fields such as photograph- 
ically illustrated reference books having numerous 
visual images and audio code images arranged on one 
leaf (one page). 

[0025] Other features and advantages of this invention 
will be apparent from the following description of 
embodiments of the invention to be taken with reference 
to the drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0026] 

Fig. 1 is a block diagram showing an outline of a 
photo processing apparatus which is one embodi- 
ment of image processing apparatus according to 
this invention; 

Fig, 2 is an explanatory view showing an audio 
reproduction from a photograph with an audio code 
image according to this invention; 
Fig. 3 is a block diagram showing main functions of 
a controller; 

Fig. 4 is an explanatory view showing a link struc- 
ture of image data and audio code data; 
Fig. 5 is a block diagram showing an outline of 
another embodiment of image processing appara- 
tus according to this invention; 
Rg. 6 is a block diagram showing an outline of a fur- 
ther embodiment of image processing apparatus 
according to this invention; 
Rg. 7 is a block diagram showing an outline of a fur- 
ther embodiment of image processing apparatus 
according to this invention; 
Rg, 8 is a block diagram of an embodiment of 



image processing apparatus of this invention con- 
structed with emphasis placed on the function of a 
link processing device; 

Fig. 9 is a flow chart showing a processing 
5 sequence of the image processing apparatus of 
Fig. 8; 

Fig. 10 is a schematic view showing a monitor 
screen of the image processing apparatus accord- 
ing to this invention; 

10 Fig. 11 is a schematic view illustrating an image ID, 
image information with the image ID and audio 
information with the image ID; 
Rg. 12 is a view showing New Year's photo cards 
as examples of audio-coded recording media; 

15 Fig. 1 3 is a block diagram of another embodiment of 
image processing apparatus of this invention con- 
structed with emphasis placed on the function of 
the link processing device; 
Fig. 14 is a block diagram of a further embodiment 

20 of image processing apparatus of this invention 
constructed with emphasis placed on the function 
of the link processing device; 
Fig. 15 is a schematic view illustrating an audio ID 
and link information; 

25 Rg. 16 is a schematic view illustrating a simple 
image ID and audio ID; 

Rg. 17 is an explanatory view showing a flow of 
making photographs with audio code images with a 
photograph making apparatus according to this 
30 invention; 

Fig. 18 is a schematic view showing a linked rela- 
tionship among image data, audio data and ID code 
in one object; 

Fig. 19 is a schematic view showing an audio- 
35 coded photograph ; and 

Fig. 20 is a functional block diagram showing the 
apparatus for making photographs with audio code 
images in one embodiment of this invention. 

40 BEST MODE FOR CARRYING OUT THE INVENTION 

[0027] Fig. 1 is a block diagram of a photo processing 
apparatus 1 which is one form of image processing 
apparatus for making audio-coded recording media 

45 (photographs) according to this invention. This photo 
processing apparatus 1 includes a projecting and 
exposing station 20 for projecting photographed images 
of photographic film 2 (hereinafter called the film) to 
printing paper 3 acting as a photosensitive material, a 

50 CRT printer or PLZT printer acting as a silver salt color 
printing paper (photosensitive material) printer 31 act- 
ing as a printing device 30 for printing audio code 
images on the printing paper 3. a loop forming station 
40 for forming a loop of printing paper 3 to transport the 

55 printing paper 3 independently for printing processes at 
the projecting and exposing station 20 and at the photo- 
sensitive material printer 31, a developing station 50 for 
developing printing paper 3 after the printing processes. 
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an audio signal irput unit 60 for acquiring audio signals, 
and a controller 100 for controlling the components of 
the photo processing apparatus 1 and computing vari- 
ous data. The controller 100 has. connected thereto, a 
console 101 for inputting various information, and a 5 
monitor 102. 

[0028] The printing paper 3 drawn out of a printing 
paper magazine 4 storing the printing paper 3 in a roll 
has photographed images printed thereon from the film 
at the projecting and exposing station 20, and audio 10 
code images printed at the CRT printer 31 , and is there- 
after developed at the developing station 50, as shown 
in Fig. 2, cut to a size including a photograph (visual 
image) 6 and an audio code image 7 for one frame of 
the film, and discharged as audio-coded photographic is 
prints 5. When this audio code image 7 is scanned man- 
ually with a special reading scanner 8, a sound corre- 
sponding to the audio code image 7 is outputted from 
the speaker by the action of an audio reproduction cir- 
cuit mounted in the scanner 8, 20 
[0029] The respective components shown in Fig. 1 will 
be described hereinafter. 

[0030] The projecting and exposing station 20 
includes an exposing light source 21, a light adjustment 
filter 22 for adjusting a color balance of light irradiating 25 
the film 2, a mirror tunnel 23 for uniformly mixing the 
colors of the light having passed through the light 
adjustment filter 22, a printing lens 24 and a shutter 25 
for forming images of film 2 on the printing paper 3, and 
a paper mask 26 for setting an exposure area to the so 
printing paper 3. all arranged on the same optical axis 
providing an exposure optical path. 
[0031] A photographic image scanner 9 Is disposed 
on a film transport path upstream of the projecting and 
exposing station 20 for scanning the photographed 
images formed on the film 2 and acquiring them as dig- 
ital images. The scanner 9 irradiates the film 2 with 
white light, separates the light reflected from or trans- 
mitted through the film 2 into three primary colors of red, 
green and blue, which are detected by a CCD line sen- 
sor, put to an A/D conversion and transmitted to the con- 
troller 100. 

[0032] As shown in Fig. 3. the controller 100 includes 
an exposure control unit 110 whose main function is 
exposure control of the projecting and exposing station 
20, a code data generating unit 120 for processing the 
audio signals inputted from the audio input unit 60 to 
generate corresponding audio code data, and a central 
control unit 130 for controlling these units 110 and 120. 
[0033] The exposure control unit 110 includes a first 
storage 1 1 1 for storing the image data received from the 
scanner 9, an exposure condition computing unit 1 12 for 
determining exposure conditions by using the image 
data stored in the first storage 1 1 1 , an exposure control- 
ler 113 for controlling operation of the light adjustment 
filler 22 and shutter 25 at the projection exposure sta- 
tion 20 based on the exposure conditions determined by 
the exposure condition computing unit 112, and an 



Image data converter 1 14 for converting the image data 
read from the first storage 1 1 1 into simulated image 
data for display on a monitor display 102 based on the 
exposure conditions determined by the exposure condi- 
tion computing unit 112. Various parameters recorded 
in the image data converter 114 for use in conversion 
processes such as a negative-to-positive conversion of 
image data are set to display images on the monitor dis- 
play 102 which are equivalent of images to be formed 
on the printing paper 3 by projecting the photographed 
Image frames of photographic film 2 with the exposure 
conditions determined by the exposure condition com- 
puting unit 112. If simulated images displayed on the 
monitor display 102 are unsatisfactory, the exposure 
conditions may be altered by using the console 101 to 
manually input variations in exposure of each of Y (yel- 
low). M (magenta) and C (cyan) or average variations in 
exposure corresponding to density variations of the 
photographs. 

[0034] Audio information inputted to the audio input 
unit 60 through audio recording media such as a micro- 
phone, tape-recorder. CD, MD and memory card, or 
public communications networks such as the telephone 
and Internet, are transmitted to the code data generat- 
ing unit 120 after an A/D conversion in the case of ana- 
log audio signals, or as data in the case of digital 
signals. The code data generating unit 120 includes a 
compressor 121 for compressing digital audio signals, 
an error correction encoder 122 for adding error correc- 
tion codes by an error correction code algorithm based 
on a coding theory, a code data developer 1 23 for devel- 
oping the audio data compressed and with the error cor- 
rection codes added thereto, into code data according 
to a predetermined rule, a second storage 124 for stor- 
ing the developed code data, and an interface 125 for 
reading the code data from the second storage 124, 
converting them into audio code images 7 which are 
printing data corresponding thereto, and transmitting 
them to the CRT printer. In this embodiment, the code 
converter for converting the inputted audio information 
into audio code images 7 are composed of the com- 
pressor 121. error correction encoder 122 and code 
data developer 123. This code data generating unit 120 
further includes a reproducer 126 for accessing the sec- 
ond storage 124 and performing processes such as 
reverse conversion and en-or correction, for enabling 
confirmation of sound with a monitor speaker 103. 
[0035] The photo processing apparatus 1 in this 
embodiment employs a construction capable of trans- 
mitting Image information of the photographed images 
of film 2 acquired by the scanner 9 and stored in the first 
storage 111 to the photosensitive material printer 31 
through the image data converter 114 and interface 
125. This printer 31 can print, on the printing paper 3, 
both visual images 6 v^^ich are the images of film 2 and 
audio code images 7. 

[0036] A process of making audio-coded photographs 
5 with this photo processing apparatus 1 will be 
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described next with reference to Fig. 1. 
[0037] The user brings a photographed film 2 and a 
tape, disk, memory card or the like recording the sound 
to be combined to a photo processing agent, and fills in 
a predetermined print order card with the frame num- 
bers of photographed images to be made into audio- 
coded photographs 5 and the recorded parts of the 
sound to be combined with the photographed images. 
When no media recording the sound to be combined 
has been brought in, an input is made directly to the 
audio input unit 60 from a microphone provided by the 
photo processing agent. The film 2 brought in is loaded 
into the photo processing apparatus 1 after a develop- 
ing process if the film is undeveloped, or loaded as it is 
if already developed. 

[0038] The film 2 loaded is transported to the project- 
ing and exposing station 20 by a film transport mecha- 
nism 70 having a plurality of transport rollers 71 and a 
motor 72 for driving the transport rollers. At this time, 
each photographed image is scanned by the scanner 9, 
and acquired digital image data is stored in the first stor- 
age 1 11 as noted hereinbefore. At the same time, audio 
signals also are inputted to the controller 100 through 
the audio input unit 60, and stored in the second storage 
124 in the form of audio code data as noted hereinbe- 
fore. Order information recorded on the print order card 
is applied automatically or manually to the controller 
100. The central control unit 130 receives an image ID 
and an audio ID applied to each photographed image 
frame number as shown in Fig. 4. Further, the image ID 
is linked to the address of the pertinent image data 
stored in the first storage 111. The audio ID is linked to 
the address of the pertinent audio code data stored in 
the second storage 124. Such link information is gener- 
ated and controlled by the central control unit 130 and 
stored in a link information storage 131 . That is, the cen- 
tral control unit 130 and link information storage 131 act 
here as a link processing device for linking the photo- 
graphed images of film 2 and audio signals correspond- 
ing thereto. Consequently, the photographed images 
and sound inputted to this photographic processing 
apparatus 1 are reliably combined in corresponding 
relations to be printed on the printing paper 3. 
[0039] When printing the photographed images of film 
2 on the printing paper 3 at the projecting and exposing 
station 20, the exposure control unit 110 controls the 
light adjustment filter 22 based on the image data 
acquired by the scanner 9, thereby adjusting the irradi- 
ating light of exposure light source 21 to a color balance 
corresponding to the color density of the images on the 
film 2- At the projecting and exposing station 20. the 
shutter 25 is operable to irradiate the film 2 with the 
adjusted light to print the photographed images of film 2 
on the printing paper 3. At this time, the paper mask 26 
is controlled to vary exposure areas on the printing 
paper 3. For example, unimportant regions of the photo- 
graphed images are masked and processed to become 
a white background after development without being 



printed. Audio code images may be printed in such 
regions by the CRT printer 31 . Thus, audio codes may 
be incorporated into photographs of an ordinary print 
size. 

5 [0040] The printing paper 3 printed is successively 
transported by a printing paper transport mechanism 
80. This printing paper transport mechanism 80 
includes the above-mentioned loop forming section 40. 
The loop forming section 40 has transport rollers 81 and 

10 82 for transporting the printing paper 3, and a motor 84 
for driving the transport roller 81. Though not shown in 
the drawing, a flap is disposed between the roller 81 
upstream with respect to a printing paper transport 
direction and the roller 82 downstream with respect to 

75 the printing paper transport direction, which is switcha- 
ble between a position for linearly guiding the printing 
paper 3 between the transport rollers 81 and 82, and a 
position for allowing the printing paper 3 to form a loop 
as shown in Fig. 1. By forming a loop of printing paper 

20 3, transport processes may be performed Independ- 
ently for the projecting and exposing station 20 and for 
the photosensitive materia! CRT printer 31, with an opti- 
mal transport speed set for each. 
[0041 ] Where the photographed images of film 2 are 

26 printed on the printing paper 3 not at the projecting and 
exposing station 20 but at the CRT printer 31, the film 2 
scanned by the scanner 9 is not used at the projecting 
and exposing station 20. and therefore is drawn out 
straight. The photographed images made into digital 

30 images are printed on the printing paper 3 by the CRT 
printer 31 after the conversion processes at the image 
data converter 1 14 and at the interface 125 for the CRT 
printer 31 . In that case, data of visual images of the pho- 
tographed images and data of the audio code images 

35 may be composed beforehand in the controller 1 00 and 
transmitted to the CRT printer 31 as one printing data, 
or may be printed separately as two printing data by 
moving the printing paper 3 a predetermined amount 
between prints. Where the data are composed before- 

40 hand in the controller 1 00, there is of course a degree of 
freedom for effecting various digital processes in time of 
composition. 

[0042] Though not shown in the drawing, the develop- 
ing station 50 includes a plurality of tanks filled with 

45 treating liquids for developing the printing paper 3 after 
a printing process. The printing paper 3 is developed by 
passing successively through the plurality of tanks. A 
transport control of printing paper 3 through the devel- 
oping station 50, and controls of the motor 72 of the film 

50 transport mechanism and the motors 84 and 85 of print- 
ing paper transport mechanism 80. are centrally con- 
trolled by the controller 100. 

[0043] The photo processing apparatus 1 shown in 
Fig. 5 is different from the photo processing apparatus 1 
55 shown in Fig. 1 in that the controller 100 has an image 
signal input unit 10 for receiving image data from a flat- 
bed scanner 10a which is one example of devices for 
acquiring digital images from photographic prints. This 
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provision is made in order to make new audio-coded 
photographs 5 by combining photographic prints with 
audio code images even when the user brings the pho- 
tograph prints instead of a photographic film 2. Image 
data of the photograph prints acquired with the fiat-bed 
scanner 10 are stored in the first storage 111 of expo- 
sure control unit 110. The image data, after being proc- 
essed by the image data converter 1U and interface 
125, are printed on the printing paper 3 with audio code 
images by the photosensitive material printer 31 such 
as the CRT printer or PLZT printer, developed at the 
developing station 50, and discharged as audio-coded 
photographs 5. The image signal input unit 10 has an 
interface for receiving image data from digital photo- 
graphing devices such as a video movie camera 10b 
and a digital still camera 10c and a computer lOd capa- 
ble of making or editing images. Thus, the controller 100 
receives image data from various media. Though not 
shown in the drawing, the controller 100 may of course 
receive image data and audio data through telecommu- 
nication lines. 

[0044] The photo processing apparatus 1 shown in 
Fig. 6 is a modification of the apparatus shown in Fig. 5, 
which employs a non-photosensitive material printer 32 
such as a thermal printer or an ink jet printer instead of 
the photosensitive material printer 31 to form audio- 
coded photographs 5 not on the printing paper 3 but on 
heat-sensitive paper, coated paper or the like. A thermal 
printer in particular is used to make seal prints besides 
index prints in ordinary photo processing, and may not 
only be used as it is for printing out audio-coded photo- 
graphs 5 but provide an additional advantage that the 
printed audio-coded photographs may readily stick to an 
album or surfaces of other articles by using seal paper. 
[0045] The photographic processing apparatus 1 
shown in Fig. 7 is different from the photo processing 
apparatus 1 shown in Fig. 1 in that a non-photosensitive 
material printer 32 such as a laser beam printer or an 
ink jet printer Is used as printing device 30 for printing 
out audio code images at a high enlargement ratio not 
on the printing paper 3 but on transparent film 1 1 . Using 
the transparent film 1 1 having the enlarged audio code 
images formed thereon, the projecting and exposing 
station 20 prints the audio code images in an appropri- 
ately reduced size on the printing paper 3. Audio code 
images of increased minuteness may be formed by 
changing the printing lens 24 of projecting and exposing 
station 20 for one of high precision. 
[0046] In the embodiments of photo processing appa- 
ratus 1 shown in Figs. 5, 6 and 7, image information to 
be processed comprises digital images made or edited 
by the computer lOd using image generating software, 
digital images supplied from image acquiring devices 
such as a scanner and a digital camera, and digital 
images read from recording media such as FDs and 
CD-Rs. The images may be outputted by a hard copy 
device such as a printer as audio-coded photographs by 
combining them with audio code images based on 
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audio information acquired from a microphone, cassette 
tapes or CDs. In this case, corresponding image infor- 
mation and audio information must be linked in the 
photo processing apparatus 1. For this purpose, as 
5 described hereinbefore, the link processing device for 
generating and controlling link information is provided 
by the central control unit 130 and link information stor- 
age 131. 

[0047] Operation of the image processing apparatus 1 . 

10 according to this invention constructed with emphasis 
placed on the function of the link processing device will 
be described hereinafter, along with several embodi- 
ments, with reference to Figs. 8 through 16. Here, the 
image signal input unit 10 has an image input processor 

15 210, an image editor 212 and an image selector 214. 
The audio input unit 60 has an audio input processor 
218. an audio editor 220 and an audio selector 222. 
Reproduction of inputted sound and monitoring of input- 
ted images are carried out through the monitor 102 and 

20 speaker 103 by operating a user input setter 216 formed 
in the console 101. Further, the link processing device 
provided by the central control unit 130 and link informa- 
tion storage 131 in the foregoing description is shown 
here as a link processing unit 130a expressed by a col- 

25 lection functional blocks such as an ID information pro- 
vider 230 and a link information setter 236. Further, the 
code data generating unit 120 is shown as a code con- 
verter 242 having an audio data compressor/encoder 
238 constructed with a suitable one selected from 

30 known coding techniques such as waveform coding, 
analytico-synthetic coding and so on, and an audio 
code image generator 240 for developing the coded 
audio code data into two-dimensional code images. A 
synthesizer 140 for synthesizing the visual images 

35 Stored in an image data storage 232 and the audio code 
images stored in an audio code image storage 244 
includes a visual/audio code image layout editor 234 
and a visual/audio code image synthesizer 246. com- 
bines the visual images and the audio code images in 

40 desired layouts based on the link Information set by the 
link processing unit 130a, and transmits them to the 
printing device 30. 

[0048] The embodiment shown in Fig, 8 will be 
described first with reference to the flow chart of Fig. 9. 

45 [0049] Image information is inputted from a film scan- 
ner, a scanner, a digital camera, a video camera, an FD 
(floppy disk), a PC (personal computer) or the like to the 
image input processor 210 (#1). The image information 
is transmitted to the image editor 212 where editing 

50 processes such as color tone/gradation conversion and 
enlargement/reduction are performed through controls 
from the user input setter 216 while images are con- 
firmed on the monitor 102 (#2). Edited images are 
transmitted to the image selector 214 where an image is 

55 selected for printing. 

[0050] On the other hand, audio information is input- 
ted from a microphone, a cassette tape-recorder, a CD 
(compact disk), a digital voice recorder or the like to the 
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audio input processor 218 (#1 ). The audio information is 
transmitted to the audio editor 220 where audio editing 
processes are performed through controls from the user 
input setter 216 while sound is corrtirmed with the 
speaker 1 03 (#3). Edited audio data is transmitted to the 5 
audio selector 222 where a sound is selected for linking 
to the image selected by the image selector 214 (#6). 
[0051] The image selector 214 and audio selector 222 
will be described here with reference to Fig. 10. In this 
embodiment, the image monitor 102 has a monitor 10 
screen 102b as shown in Fig. 10. The user input setter 
216 includes a personal computer's keyboard 101a, 
mouse 101b and their interface circuits. The user, while 
looking at a plurality of images displayed on the monitor 
102, selects an image to be printed and a sound to be is 
converted into an audio code by using a cursor 102a on 
the screen interlocked to the mouse 101b. As a method 
of selection, an image is selected by placing the cursor 
on the image to be printed (IMG4 in Fig. 10) and clicking 
on it (#4). Further, a sound to be linked to the image is 20 
selected by dragging the cursor to an audio symbol 
(SP1 in Fig. 10) and dropping It there (#6). The audio 
symbols displayed on the screen are only symbol 
images showing, for example, the names, numbers or 
the like of tunes for distinguishing sounds. Thus, for con- 25 
firming audio contents, a desired audio symbol on the 
monitor screen is designated with the cursor ard dou- 
ble-clicked to reproduce an actual sound from the 
speaker 103. 

[0052J The selected image data is transmitted to the 30 
ID information provider 230 where image ID information 
supplied by the ID information supplier 228 is applied by 
the image ID information provider 226 (#5). As shown in 
Fig. 10, actual image ID information is set by an input 
made from the keyboard 101a by the user. Image ID 35 
information D1 applied to the image by the image ID 
information provider 226 is transmitted to the link infor- 
mation setter 236. Image information D2 to which this 
image ID is applied as a header is once stored in the 
image data storage 232. As shown in Fig. 1 1 (a), image 40 
ID information D1 , for example, includes an image serial 
No., an individual number, an input mode number, an 
identification number and a frame number. The individ- 
ual number comprises customer's telephone number 
and date of birth. The input mode number identifies the 45 
medium serving as the source of the image, which is a 
sign indicating a photographic film, a photographic print 
or a digital camera, for example. The identification 
number corresponds to a film number including a lab 
shop number in the case of a photographic film, or an iD so 
number or volume name in the case of a storage 
medium such as Smart Media. As shown in Rg. 1 1 (b). 
image information D2 with an image ID has the above 
image ID allocated to the header, and the image data in 
an appropriate format (JPEG, GIF. PICT or the like) to a 55 
data section. 

[0053] On the other hand, the audio information 
selected by the audio selector 222 for combination with 



a particular image Is transmitted to the link information 
setter 236. The link information setter 236 adds an 
image ID of the image to be combined received from the 
image ID information provider 226, as a header of this 
audio information and as link information (#7). Fig. 1 1 
(c) shows a data format of audio Information D3 with link 
information. Audio Information D3 with link information 
is transmitted to the audio data compressor/encoder 
238 where only the audio data is compressed. Subse- 
quently, at the audio code image generator 240, the 
compressed audio data and the link information are 
converted into optically readable audio code images 
(#8). The data of the audio code image Is stored once in 
the audio code image storage 244. 
[0054] The image data stored in the Image data stor- 
age 232 and the audio code image stored in the audio 
code image storage 244 to be linked to this image are 
taken into the visual/audio code image layout editor 
234, relying on the link information applied as noted 
above, where a layout editing process is performed for 
the visual image and audio code image (#9). In an 
actual layout editing process, a layout editing screen is 
displayed on the screen 102b of monitor 102 shown in 
Fig. 10, and a layout editing process is performed for the 
visual Image and audio code image on instructions 
given with the cursor. For example, after the editing 
process, a display is made of the visual and audio code 
images combined and laid out as desired. When, in the 
layout editing, the visual and audio code images to be 
printed are determined to be NG. the operation returns 
to the process at the image editor 212 or audio code 
image generator 240 to carry out a necessary process 
again. When, for example, the audio code image 
exceeds a printable length, a revision Is made to sepa- 
rate it into two parts for a two-tier arrangement. Further, 
by designating an audio code image displayed on the 
monitor screen 102b with a mouse 101b and double- 
clicking on it, a corresponding audio source is read from 
a temporary storage medium not shown, and outputted 
from the speaker 103. 

[0055] The visual/audio code image synthesizer 246, 
upon receipt of layout information from the visual/audio 
code image layout editor 234, transmits a request signal 
to each of the image data storage 232 and audio code 
image storage 244. and receives the corresponding 
image data and audio code image data obtained from 
the layout information and link information. The image 
data and audio code image data received are integrated 
to synthesize print image data. The print image data is 
transmitted to the printing device 30 to print a composite 
image (#10). 

[0056] The visual/audio code image layout editor 234 
may perform a layout editing process by first taking in 
the audio code image stored in the audio code image 
storage 244 and. based on the link information 
extracted from the audio code image, taking In the 
Image data having the link information agreeing with the 
extracted link Information from among the image data 
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stored in the image data storage 232, or may perform a 
layout editing process by first taking in the image data 
stored in the image data storage 232 and. based on the 
link information extracted from the image data, taking in 
the audio code image having the link information agree- 
ing with the extracted link information from among the 
audio code images stored in the audio code image stor- 
age 244. 

[0057] Fig. 12 shows new year's greetings postcards 
with a photograph as an example of audio-coded 
recording media printed out. Fig. 12 (a) shows the back 
of a new year's greetings postcard with an audio code 
image 7 disposed in a blank region not recording the 
photograph or characters. Fig. 12 (b) shows the back of 
a new year's greetings postcard with an audio code 
image 7 disposed in a masking region formed with a 
white undercoat seal in a visual image recording region 
where the photograph and characters are recorded. Fig. 
12 (c) shows the front of a new year's greetings post- 
card with an audio code image 7 printed above the new 
year's gift number, visual images such as the photo- 
graph and characters being printed on the back. For this 
purpose, the visual/audio code image layout editor 234 
and visual/audio code image synthesizer 246 have also 
functions to develop the visual and audio code images 
on a plurality of printing sheets. 
[0058] Further. Fig. 12 (d) shows the back of a new 
year's greetings postcard with an audio code image 7 
superimposed on the image in a visual image recording 
region as a stealth type code invisible under visible light. 
A material used for recording the stealth type audio 
code image may be a fluorescent materia! which is 
transparent under visible light and emits light when irra- 
diated with ultraviolet light. 

[0059] The embodiment shown in Fig. 13 is different 
from the embodiment shown in Fig. 8 in that the code 
converter 242 includes a pre-code image generator 
252. The pre-code image generator 252 computes a 
size (outside dimensions) of the audio code image for 
audio information to be combined with an image, and 
transmits it to the visual/audio code image layout editor 
234. The visual/audio image layout editor 234 performs 
a layout editing process for the visual image and the 
audio code image by using the size of the audio code 
image computed. Subsequently, layout information is 
transmitted to the audio code image generator 240. 
Since the size of the audio code image to be used is 
known, in the layout editing operation, the visual image 
and audio code image may be arranged in a layout with- 
out an unused blank. The audio code image may be 
divided automatically as necessary. The layout process 
may be performed efficiently since a layout may be 
made through the pre-code image generation which 
requires only a short processing time without a time- 
consuming audio code image generation 
[0060] After completing such layout editing, the audio 
information is coded. The audio code image generator 
240 combines the audio code data and the link informa- 



tion including the layout information, and encodes and 
turns the information into an image as one audio code 
data. Since the printed audio code image has the layout 
information, a layout editing operation may be omitted 

5 by reading this layout information in the event of a 
request for duplicates made from the print again or for 
additional prints of the audio photograph. 
[0061] The embodiment shown in Fig. 14 is different 
from the embodiment shown in Fig. 8 in that the link 

TO processing device 130a additionally includes an audio 
ID information provider 254 for providing audio ID infor- 
mation, and a link information controller 256 for control- 
ling link information, and that a controlling link 
infonnation setter 258 is provided in place of the link 

15 information setter 236. The audio ID information pro- 
vider 254 applies audio ID information supplied by the 
ID information supplier 228 to selected audio informa- 
tion. As shown in Fig. 15 (a), the audio ID is in a data 
format similar to the above-mentioned image ID (Fig. 1 1 

20 (b)). The input mode number is a sign showing an audio 
source medium such as post-recording, cassette. MD or 
FD. 

[0062] The ID information supplier 228, image ID 
information provider 226 and audio ID information pro- 

25 vider 254 constitute the ID information provider 230. Set 
image ID and audio ID are integrated by the controlling 
link information setter 258 to become controlling link 
infomfiation. Fig. 1 5 (b) shows a data format of the con- 
trolling link information, which includes a serial number 

30 acting as an ID of an audio-coded recording medium to 
be made, an image ID, an audio ID and date informa- 
tion. Further, this link information may have, added 
thereto through the controlling link information setter 
258, layout information showing a layout of the visual 

35 image and audio code image determined by the vis- 
ual/audio image layout editor 234. 
[0063] The controlling link information generated by 
the controlling link information setter 258 is transmitted 
to the link information controller 256. The link informa- 

40 tion controller 256 controls the controlling link informa- 
tion by database. The link information controller 255 
transmits the controlling link information in response to 
a request signal from the visual/audio code image syn- 
thesizer 246. The visual/audio code image synthesizer 

45 246 transmits a request signal relating to the Image data 
to be printed to the image data storage 232 to receive 
the image data, and transmits a request signal relating 
to the audio code image to the audio code image stor- 
age 244 to receive the audio code image. The image 

so data and audio code image data received are integrated 
to generate print image data. In this construction, a 
process is carried out efficiently for outputting prints 
from a plurality of image data and audio code image 
stored and accumulated. Thus, as a result of the con- 

55 trolling link information being used as image and audio 
source address information, use may be made freely as 
image source not only of what is inputted from the 
image input processor 210 each time, but of data read 
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from an image database 280 storing numerous images 
and an audio data base 290 storing numerous sounds. 
[0064 J The embodiment according to Fig. 8 is 
described with the construction which uses the image 
ID for link information, but it is possible to use the audio 
ID for link information. In an embodiment which limits 
the image source to photographic films, the image ID 
used as link information may include a film number 
serving as an identification number and a frame number 
identifying an image as shown in Fig. 16 (a). The audio 
ID may include only an identification number 
[0065] In the foregoing embodiments, a CRT printer or 
PLZT printer is used as the printing device 30 for form- 
ing visual images and audio code images on the print- 
ing paper 3. A liquid crystal printer, fluorescent tube 
printer or laser exposure heat developing device may be 
employed. In this case, the photo processing apparatus 
1 may be a completely digital photo printer with the pro- 
jecting and exposing device 20 omitted therefrom. 
[0066] Various techniques known per se may be used 
as the code data generating unit 120, i.e. code con- 
verter 242, for turning audio signals into optically reada- 
ble code images. It is possible to divert, for example, the 
technique of the Information recording and reproduction 
system using dot codes which is desaibed in detail in 
Patent Laying-Open Publication H6-231466. It Is also 
possible to divert the technique of two-dimensional bar 
codes of the stack type or matrix type. 
[0067] Audio-coded recording media and a flow of 
operation for making the recording media in a different 
embodiment of this invention will be described next with 
reference to Figs. 17 through 20. Fig. 17 is a view show- 
ing a flow of making audio-coded photographs with an 
audio-coded photograph making apparatus in this 
embodiment. 

[0068] A customer who orders audio-coded photo- 
graphs brings image recording media such as photo- 
graphs or negative films which are a source of still 
images, and audio recording media such as cassette 
tapes, serving as image information source and audio 
information source, or sound and image recording 
media such as a digital camera or digital video record- 
ing both sound and images, and indicates which images 
and sound should be combined. The sound and images 
in the recording media received are encoded as neces- 
sary, and temporarily stored in a storage medium such 
as a hard disk as image data and audio data in a format 
processable by the apparatus. This storage medium 
stores not only the image data and audio data received 
from the customer but data of various landscapes, illus- 
trations, environmental sounds and so on. The cus- 
tomer may select these landscapes, illustrations and 
environmental sounds for incorporation into the audio- 
coded recording media. 

[0069] The operator combines the image data and 
audio data temporarily stored in the storage medium as 
required by the customer, and creates audio-coded 
photographic objects. Each audio-coded photographic 



object corresponds to one audio-coded photograph. 
One audio-coded photographic object includes at least 
one image data and at least one audio data, but actually 
has only pointers indicating links of the data, 

5 [0070] Once predetermined image data and audio 
data are combined, an ID code acting as a recognition 
sign showing mutual correspondence is applied to the 
image data and audio data as link information. This ID 
code is generated for each combination of image data 

10 and audio data in one object and applied commonly 
thereto. The link relation between these is schematically 
shown in Fig. 18. As the ID code, a mere ordinal number 
may be used, or a character string descriptive of the 
content of the audio code may be used. Depending on 

15 circumstances, a line linking the corresponding image 
data and audio data may be employed as the recogni- 
tion sign in place of the ID code. Further, a mark emit- 
ting a sound (audio code or the like) or light 
(fluorescence or the (ike) may be used as the recogni- 

20 tion sign. In any case, any form is acceptable as long as 
the sign can show a mutual correspondence between 
each still image and each audio code. 
[0071 ] Once an audio-coded photographic object is 
determined, the image data is put to a two-dimensional 

25 development and the audio data developed into a two- 
dimensional code based on its object makeup informa- 
tion. The ID code also is developed into an image. 
These are combined and stored in a frame memory. A 
composite image to be ultimately printed as an audio- 

30 coded photograph by using the composite data stored 
In the frame memory is displayed on a monitor screen 
as shown in Fig. 19. 

[0072] The operator may look at the monitor screen 
and check visual images and a layout of the still images 

35 and audio code Images and may confirm combinations 
of the still images and audio codes through the ID codes 
for the predetermined audio-coded photograph. The 
contents of the audio codes, i.e. the sounds themselves, 
cannot be confirmed on the monitor screen. To confirm 

40 the sounds of the audio codes, a mouse or the like is 
clicked on the audio codes displayed or frames repre- 
senting the audio codes on the screen, or ID codes are 
key-inputted from a console. The sound corresponding 
to the audio code selected may be produced from a 

45 speaker by the following two methods. 

[0073] In one method of hearing the sound, a storage 
position of the audio data corresponding to the clicked 
or selected audio code is located by using object 
makeup information. This audio data is put to an appro- 

50 priate decoding process, and transmitted to the speaker 
to produce the sound. This method is based on the pre- 
condition that the audio data corresponding to the audio 
code is stored in an accessible form. In the other 
method used where the above precondition is not satis- 

55 fled, the two-dimensional code corresponding to the 
selected audio code is taken out of the frame memory 
as separated from the still image data. The two-dimen- 
sional audio code is put to a reverse conversion to 
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restore the original audio data. The audio data restored 
is put to an appropriate decoding process, ard transmit- 
ted to the speaker to produce the sound. 
[0074] The composite image confirmed on the monitor 
screen is transmitted from the frame memory to a silver s 
salt type printer or a thermal printer to output an audio- 
coded photograph. The audio-coded photograph fin- 
ished in this way is passed on to the customer. The cus- 
tomer may hear the sound by scanning the audio codes 
with a known audio code reading scanner. io 
[0075] One example of apparatus for making audio- 
coded photographs in the above flow of operation will be 
described with reference to the functional block diagram 
shown In Fig. 20. 

[0076] An input unit 300 is a generic term including a is 
fiat-bed scanner for acquiring information from still 
images such as photographs, posters and so on, a film 
scanner for acquiring information from still images such 
as of negative films, a special reader for reading Infor- 
mation from a digital camera and digital video, and vari- 20 
ous audio players for using cassette tapes. CDs and so 
on as input sources. An image encoder 311 is operable 
to convert inputted image information into a digital for- 
mat for processing in this apparatus. An audio encoder 
312 is operable to convert inputted audio information 25 
into the digital format for processing in this apparatus. A 
storage 320 stores image data and audio data con- 
verted by the encoders 311 and 312. The storage 320. 
while temporarily storing the data brought in by custom- 
ers, also stores, until deleted forcibly, image data and 30 
audio data as a stock of materials available for selection 
by the customers as they wish. 
[0077] An object generator 330 selectively reads 
image data and audio data from the storage 320 by 
using file names or the like, and generates an audio- 35 
coded photographic object to make an audio-coded 
photograph. Each time a combination of image data and 
audio data is determined, an ID code acting as a recog- 
nition sign tor that combination is applied by an ID code 
generator which is one example of recognition sign pro- 40 
vider. Thus, as seen from Figs. 17 and 18, this audio- 
coded object includes image data, audio data and ID 
codes. The makeup pattern of the object determined is 
maintained in the form of object makeup information by 
an object makeup information controller 331 . 45 
[0078] This information must be developed in a frame 
memory 350 in order to display on a monitor 360 or out- 
put from a printer 370 an audio-coded photograph 
based on the object determined. For this purpose, the 
image data of the object determined is developed by an so 
image data two-dimensional developer 341 , and trans- 
mitted to the frame memory 350. The audio data is 
developed by an audio data two-dimensional encoder 
342. and transmitted to the frame memory 350. The ID 
code also Is developed into an image, and placed in a ss 
predetermined position. The data loaded into the frame 
memory 350 are printed by an ink jet type or thermal 
type printer 370 as an audio-coded photograph as 



shown in Fig. 19. The audio-coded photograph has cor- 
responding still images and audio codes to which ordi- 
nate numbers. "01" and "02" here, are applied as 
common ID codes, which facilitates confirmation of the 
audio codes corresponding to the still Images. Numeral 
390 denotes a controller for controlling each functional 
component of the apparatus for making audio-coded 
photographs. 

[0079] A construction for checking the contents of the 
audio data displayed on the monitor 360 will be 
described next. 

[0080] A pointing device 381 such as a mouse is used 
to select the frame of an audio code to be checked. The 
controller 390 identifies a corresponding audio data 
from the object makeup information, and reads the cor- 
responding audio data from the storage 320 by means 
of an audio data retriever 382. The audio data read is 
put to a necessary decoding process at an audio repro- 
ducer 383 arxi transmitted to a speaker 384 as an 
amplified analog audio signal. As a result, an original 
sound Is released from the speaker 384 By listening to 
the sound, the operator is able to check whether the 
audio code image displayed on the monitor 360 is cor- 
rectly combined with a still image displayed simultane- 
ously 

[0081] In the absence of the selected audio code 
Image from the storage 320, the controller 390 reads 
only the audio code image corresponding to the 
selected audio code frame from the frame memory 350 
and transmits the code to a reverse converter 385. The 
reverse converter 385 carries out a process reverse to 
what is done at the audio data two-dimensional encoder 
342. to convert the audio code Into audio data. The 
audio data obtained from the reverse converter 385 is 
put to a n^essary decoding process at the audio repro- 
ducer 383 and transmitted to the speaker 384 as an 
amplified analog audio signal. As a result, an original 
sound is released from the speaker 384. 
[0082] In tiie embodiment shown in Fig. 20. the ID 
code generator 335 is employed as the recognition sign 
providing deuce. This may be constructed as a mark 
generator for adding a line or the like, in place of the ID 
code, as a recognition sign, to a composite image to link 
corresponding image data and audio data. Further, this 
mark generator may generate a mark which emits a 
sound (audio code or the like) or light (fluorescence or 
the like). A fluorescent mark may be overprinted by 
using a fluorescent Ink printer. 
[0083] In this embodiment (Fig. 19). Image data and 
audio codes are recorded along with ID codes acting as 
recognition signs on the same page. Where the recog- 
nition signs (ID codes) are recorded adjacent the image 
data and audio codes, respectively, the image data and 
audio codes may be recorded on separate pages. 
[0084] Further, where the recognition signs are 
recorded on the image data and audio codes, corre- 
spondence between the image data/audio codes and 
the recognition signs may be identified with increased 
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reliability. 

[0085] The audio codes may take the forms of not only 
the dot codes shown in Patent Laying-Open Publication 
H7-181 606 discussed hereinbefore, but all known audio 
codes such as two-dimensional bar codes that may be 
read optically to reproduce sound. 

INDUSTRIAL UTILITY 

[0086] As described above, the image processing 
apparatus according to this invention is capable of 
processing two different forms of information, audio and 
image, as linked through link information. It is conven- 
ient in making an audio-coded photograph or the like in 
which visual images corresponding to image informa- 
tion and audio code images corresponding to audio 
information are recorded on the same recording 
medium. The recording medium may be duplicated with 
ease particularly where the link information includes 
layout information showing an arrangement of the visual 
images ard audio code images to be recorded on the 
recording medium. 

Claims 

1 . An Image processing apparatus comprising: 

Image Input means for inputting image informa- 
tion; 

audio input means for inputting audio informa- 
tion; 

link processing means for setting link informa- 
tion to link said image information and said 
audio information; 

code converting means for converting said 
audio information into an optically readable 
audio code image; and 

a printing device operable based on said link 
information for recording a visual image care- 
sponding to said image information and said 
audio code image on a predetermined record- 
ing medium. 



4. An image processing apparatus as defined in any 
one of claims 1 to 3. characterized in that said link 
information includes layout information showing an 
arrangement of said visual image and said audio 

5 code image to be recorded on said recording 
medium. 

5. An image processing apparatus as defined in any 
one of claims 1 to 3. characterized in that said link 

10 Information includes source address information 
showing image information or a source storage of 
said visual image and audio information or a source 
storage of said audio code image to be recorded on 
said recording medium. 

15 

6. An image processing apparatus as defined in claim 
1, characterized in that said link information is a 
recognition sign applied commonly to said image 
information and said audio information and showing 

20 a correspondence therebetween, and 

said printing device Is operable to visibly dis- 
play and record said recognition sign on or 
adjacent said visual image and said audio code 
25 image on said recording medium, respectively 

7. An Image processing apparatus as defined in any 
one of claims 1 to 6, characterized in that said print- 
ing device is operable to record said audio code 

30 image in a blank region outside a visual image 
recording region or on the back of said recording 
medium. 

8. An image processing apparatus as defined in any 
35 one of claims 1 to 6, characterized in that said print- 
ing device is operable to record said audio code 
image in superimposition on said visual image. 

9. An image processing apparatus as defined in any 
40 one of claims 1 to 6, characterized in that said print- 
ing device is operable to combine and record said 
visual image and said audio code image. 



2. An image processing apparatus as defined in claim 

1 . characterized in that said code converting means 45 
comprises compressing and encoding means for 
compressing and encoding said audio information, 
and audio code image generating means for con- 
verting said audio information compressed and 
encoded, into an optically readable audio code so 
image. 

3. An image processing apparatus as defined in claim 
1 or 2, characterized in that said code converting 
means is operable to convert both of said audio ss 
information and said link information into an opti- 
cally readable audio code image. 



10. An image processing apparatus as defined in any 
one of claims 1 to 9, characterized in that said print- 
ing device is operable to record said visual image 
and said audio code image on a print recording 
medium. 

11. An image processing apparatus as defined in any 
one of claims 1 to 9, characterized in that said print- 
ing device is operable to record said visual image 
and said audio code Image on a photosensitive 
recording medium. 

12. An image processing apparatus as defined in any 
one of claims 1 to 11, characterized in that said 
image input means acquires image information by 
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using at least one of a scanner for reading photo- 
graphic images formed on a photograph film or 
photographic images formed on photographic 
prints, an image signal input unit for taking in photo- 
graphic images photographed with a digital still 
camera or a video movie camera, and an image 
signal input unit for taking in images made or edited 
with a computer. 



18. An audio-coded recording medium as defined in 
daim 17. characterized in that said plurality of audio 
code images are collectively arranged in a prede- 
termined audio code image recording region. 



13. An image processing apparatus as defined in any io 
one of claims 1 to 12, characterized in that said link 
processing means comprises an ID information 
applying means for applying ID information as said 
link information to identify at least one of said image 
information and said audio information, and sets is 
link information for linking one to the other of said 
image information and audio information based on 
said ID information. 

14. An image processing apparatus as defined in claim so 
13, characterized in that said link processing 
means comprises monitor means for monitoring at 
least one of said image information and said audio 
information, and information designating means for 
designating information so that one links to the 25 
other of said image information and said audio 
information monitored by said monitor means, and 
sets link information based on an output from this 
information designating means and said ID infor- 
mation. 30 



15. An image processing apparatus as defined in claim 
14, characterized in that said information designat- 
ing means is a pointing device operable by a user to 
designate desired information regarding said image 35 
information or said audio information outputted to 
said monitor means. 



16. An audio-coded recording medium made by an 
image processing apparatus defined in any one of 4o 
claims 1 to 15, said audio-coded recording medium 
being characterized in that recognition signs show- 
ing correspondence between image information 
and audio information are visibly displayed and 
recorded. 45 



17. An audio-coded recording medium with visual 
images corresponding to image information and 
audio code images corresponding to audio informa- 
tion relating to this image information recorded on so 
the same recording medium, said audio-coded 
recording medium being characterized in that a plu- 
rality of visual images con-esponding to the image 
information and a plurality of audio codes corre- 
sponding thereto are arranged, and recognition ss 
signs showing correspondence between each 
image information and audio information is visibly 
displayed and recorded. 
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FIG.2 
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